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I. INTERPOLATIVE ESTIMATION OF A VIDEO PROCESS 
USING INTER-FRAME CORRELATION PROPERTIES 

ABSTRACT 


The frame to frame correlation properties of the video process are 
utilized to reduce the mean squared error of the demodulated video where 
zero mean noise is a factor. An interpolative estimator is used for 
continuous estimation with the output process delayed in time by one 
frame. Theoretical development shows that for the model herein developed 
reduction of the mean squared error by 1.0 to 4.0 dB is possible for 
parameter ranges of interest. 


II. AN APPLICATION OF INTERPOLATIVE ESTIMATION 
TO THE APOLLO 17 TELEVISION PROBLEM 

ABSTRACT 

The theory developed in previously submitted work on interpolative 
estimation using inter-frame correlation properties of a video process is 
applied to the Apollo 17 parameters to yield a model for application on 


that mission. 



I. INTERPOLATIVE ESTIMATION OF A VIDEO PROCESS 


USING INTER-FRAME CORRELATION PROPERTIES 


INTRODUCTION 

In noisy environments television signals become corrupted and result 
in image displays which are deteriorated from the original image. Most 
images can.be considered to have a scanned output .which is positive definite, 
and which then has some non-zero mean n, The assumption that the noise has 
zero mean is generally valid. For this class of images some form of a 
processor is desired which utilizes the inter-frame correlation properties 
of television signals to reduce the mean squared error of the recovered 
image . 

Such correlation based estimation of a video signal requires large 
amounts of storage, a drawback which has eliminated frame to frame cor- 
relation estimation for most numerical methods. The following development, 
using only frame delays, makes possible application of disk recorders and 
delay lines for implementation of the solution offered. 

The correlation between frames in a video process is generally obvious, 
with a small percentage of picture elements (pixels) changing from frame to 
frame [1]. The model herein developed uses the information contained in the 
current received pixel along with the corresponding pixel in the previous 
and succeeding frames to arrive at a minimum mean squared error estimate of 
the current value. 

Development is restricted to a three frame system, but the extension 
to more frames is obvious and straightforward. 


DEVELOPMENT OF THE MODEL 


Let x(t) be a weak sense stationary random process, 
x(t) = c(t) + n(t) + m, 

E[c(t) ] = E[n(t) ] = 0, 
e E c 2 ( t ) ] = CJ 2 , 

E[n 2 (t)] = 0 2 , and 
E[x(t) ] = m. 

For t e [0,T] where T is the frame time, let 
x(t + nT) = x n (t) 

where 

x (t) = c (t) + n (t) + m. 
n n n 

Letting the argument be understood and dropping it, 

x = c + n + m, where x belongs to the n th frame, 
n n n n 

Making the assumptions, 

2 

E[n. n.] = 0 6.. where <5 . . is the Kronecker delta function [2], 

i J n ij ij 

2 2 

E[c. c.] = p,. . . a = p . . .. a , and 
i 3 (x-j) c K (j-x) c’ 

E[c. n. ] = 0, 
i J 


then 


E[x. x.l = E[(c. + n. + m)(c. + n. + m) ] 

x 3 x x 3 3 • 

2 2 2 

= p , . . , a + a 5 . . + m 
(i-j) c n i3 


E[c. x.] = p,. .. a for all i, i. 

x 2 (i-3) c J 


Now then let c be the linear minimum mean squared error estimate of c 
n 'i n 

. . * 

using the data set lx , , x , x where c is an unbiased estimator 

6 n-1 n n+1 n 

of E[c ] . 
n 


c = a .. (x .. - m) + a (x - m) + a , , (x , , - m) 
n n-1 n-1 ' n n n+1 n+1 


E[c ] = a , E[ (x .. -m)] + a E[(x. - n)] + a ,,E((x . - m) ] 

L n n-1 n-1 ■ n n J n+1 n+1 


' a n-l E[c n-l + Vl 1 + V U n + n „! + a n+l E[c n+l + I Wl> 


= 0 therefore unbiased estimator. 


By the orthogonality principle [3] 


E[(c - c ) x. ] = 0 ie{n 

n n i 


- 1, n, n + 1} 


therefore E[c x.] =E[c x.] 
n x n x 


but Efc x.] = p, .n O so 
n x r (n-i) c 

2 * 

p . .. o == E[c x. ] 

(n-x) c n x 


= a ,E[(c . + n ,) x.] + a E[(c + n ) x . J 

n-1 n-1 n-1 x n n n' i 


+ a m E[(c + n ... ) x.] 
n+1 L n+1 n+1 x 


= a (p, .. a 2 + a 2 6 . .) + a (p, . s a 2 + a 2 6 .) 

n-1 (n-l-i) c n n-1, a/ n (n-i) c n ni 

+ a n+l^(n+l-i) °c + °n ^n+l,i^ 


letting i = n-1, n, n + 1 successively 


p, 0 2 = a 1 (a 2 + 0 2 ) + a (p. a 2 ) + a , , (p„ a 2 ) 
^1 c n-1 c n n 1 c n+1 2 c 

P 2 = a (p a 2 ) + a (a 2 + a 2 ) + a . (p p 2 ) 
c n-1 1 c n c n n+1 K 1 c 

p 0 2 = a -(p., O 2 ) + a (p, 0 2 ) + a (O 2 + a 2 ) 

1 c n-1 2 c n 1 c n+1 c n 


It can be seen from the symmetry of the matrix of coefficients that appli- 
cation of Cramer’s rule will yield a n _^ = a n+ ^ so simplify to 

H °c * Vl [0 c (1 + Pz 5 + °l ] + a „ ( Pl ff c ) 

«c - a c> + a „‘°c + 0 n> 


The system determinant A follows where y is — j 


A = (1 + p 2 + ^) (1 + “) - 2 p 2 


and the coefficients 


a „ ■ i (1 + p 2 + 7 - 2p i> 
= I i 

a n-l A ( 0 


The processor is shown in Figure 1. 


NOISE REDUCTION PROPERTIES 

Since the input . "signal" to the processor is c(t) and the input 


noise is n(t) then the input mean squared error is 
MSE 1 = E[(x(t) - m - c(t)) 2 ] 

= E[(c(t) + n(t) - c(t)) 2 ] 

- E[n 2 (t)] = a 2 . 



MSE„ = (2a 2 . + a 2 ) (a 2 + a 2 ) + 4a a . p. a 2 + 2a 2 - p_ a 2 
2 n-1 n c n n n-1 1 c n-1 2 c 

- 2a 2 (2a .. p. + a ) + o 2 . 

c n-1 1. n c 


The improvement in the mean squared error then is 

MSE„ 


IMP = -10 log 


MSE, 


and for some typical values of parameters under . the assumption; e.g. 


Pl = K 


Pj = [4] 


2 11 

a = 1/12 which corresponds to c(t) distributed uniform on [- — , — ] , 
c / z 

the improvement is given in Figure 2. 


SENSITIVITY CONSIDERATIONS 

Under conditions of variation in operating parameters the sensitivity 
of , the model with fixed coefficients to these changes is of interest. 

It is to be noted that the input SNR is computed only on the varying 
part^ of the "signal", i.e. c(t), so that the power in the D.C. component 
is ignored. 

Choosing an input SNR of 8.41 dB and a K of .90 the sensitivity of 
the model to changes about this point is shown in Figure 3. It can be 
concluded from these results that small variations in y and K about a 
fixed value will not appreciably effect performance. 

AN APPLICATION ! 

The theory herein derived was applied at the request of NASA to the 


Apollo 17 television problem. Since the Apollo television system operates 
in two different modes, results were obtained for the furnished parameters 
of SNR = 9 dB and SNR = 17 dB. In Figure 4 the required coefficients . for 
the processor are graphically shown for the first case over a large 
variation in K„ Figure 5 displays the same information for the second -I 

case. Since K may vary widely due to differing video material, it should 

be determined by the user. Figure 6 shows the improvement obtainable for 
each of the modes under consideration. 

VERIFICATION OF THE VALIDITY OF THE MODEL 

In an attempt to verify the validity of the model three conditions may 
b e examined , i . e . 

1. That goes to 1.0 as y goes to infinity, and that a^_^ goes to 0 

2. That a goes to a .as K goes to 1. 

n n-1 

3. That goes to zero as K goes to zero. 

Condition 1 can be seen to be satisfied by comparing Figures 4 and 5, 

as well as examining the defining equations. The second condition is 
demonstrated in Figure 4 but may be easily shown from the equation. The 
third condition is obvious from the defining equation for a n _^" Hence 
the equations defining the model comply with , three important boundary 
conditions increasing confidence in their validity. 

SUMMARY 

A model has been developed and analyzed numerically yielding a 
theoretical reduction in mean squared error of a video process based upon 
the inter-frame correlation properties of . the process. The theoretical 


improvement obtained is substantial, enough to justify experimental 
verification. Analytical verification was offered by analysis of 
boundary conditions. Implimentation of the model is straightforward, 
and a completed processor should be realizable at reasonable cost. 
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II. AN APPLICATION OF INTERPOLATIVE ESTIMATION 
TO THE APOLLO 17 TELEVISION PROBLEM 


INTRODUCTION 

Previous work at New Mexico State University indicated substantial 
reductions were possible in the mean squared error of a video process by 
taking full advantage of the inter-frame correlation properties and devel- 
oping a linear minimum mean squared error interpolative estimator , to yield 
video delayed by one frame. The proposed model is shown in Figure 1, with 
the derived improvements over a wide range of input signal to noise ratios 
and correlation coefficients shown in Figure 2. Sensitivity to small 
variations in SNR and K with a fixed coefficient model was determined 
to be within usable limits, with these results shown in Figure 3. 

APPLICATION TO APOLLO 17 

Parameters furnished by. NASA were a signal to noise ratio for twd 
separate modes of operation, one of 9 dB and one of 17 dB. The following 
assumptions were made about this data: 

(1) the above modes could be anticipated and adjustments made int 
the processor, 

(2) that these figures represented the SNR of the demodulated video. 
Assumption 2 is the difficult one, since the television is FM modulated onto 
a carrier, and FM normally is associated with SNR improvements. Also the 
demodulated video is low pass filtered. The assumption should hold well, 
however, if the video is narrow-band FM modulated onto the carrier, and the 
SNRs given correspond to the two-sided SNR in the IF over the low-passed 
bandwidth of the video about the carrier. 


An analysis of the data given then yields the required coefficients 
shown in Figure 4 for an SNR of 9 dB, and Figure 5 for an SNR of 17 dB. 
Improvements obtainable are shown in Figure 6. The coefficients and 
improvements for the single value K = .9 are: 

SNR = 9 dB a = .565 a = .202 Imp = 2.48 dB. 
n n-1 

SNR = 17 dB a = .852 a . - .073 Imp = 0.69 dB;- 
n n-1 

As K is determined . other parameters may be found from the appropriate 
figures. 

SUMMARY 

A previously developed model was applied to the Apollo 17 television 
problem and parameters developed for application of the model. Improvement 
for each mode of operation are shown to be possible, with improvements in 
excess of 2 dB for some parameter values. 

REFERENCE 

A. L. Gilbert and F. F. Carden, "Interpolative Estimation of a Video 
Process using Inter-Frame Correlation Properties," to be published. Copy 
furnished herewith. 



LINEAR MINIMUM MSE ESTIMATOR 


FIGURE I 





18 14 10 6 SNR(dB) 

MSE IMPROVEMENT 

FIGURE 2 






.9 .8 .7 K 

EFFICIENTS FOR SNR OF 17 dB 
FIGURE 5 



1.0 .9 .8 .7 K 

IMPROVEMENT FOR SNR OF 9 A N D 17 dB 

FIGURE 6 


APPENDIX I 



DISK RECORDER SPECIFICATIONS - Two alternative configurations. 


Configuration 1 

Number of video channels 

Capability 


4 

Monochrome 


Configuration 2 

Number of video channels 

Capability 


8 

Color 


Common 

Channel configuration Each channel to have common REC/PB head 

with mode switching accomplished by 
TTL/DTL levels. Separate REC/PB amplifiers. 

Channel dependency Each channel independently available 

for RECORD or PLAYBACK mode. 

Switching time REC/PB. PB/REC 20 nanosec maximum 


Channel select imputs One per channel, high level specifying 

one mode, low level the other. 

Video channel input, output 75 ohms each 

impedence 


Input video 
Output video 
Bandwidth 


composite or non-composite, IV p~p. 
composite or non-composite, IV p-p. 
5.0 Mhz + 3 dB. 


Signal to noise ratio 
Channel capacity 


40 dB or greater, 
one NTSC video frame 


Servo synchronization Sync track mode or external syncronization 

to video sync signal. Both required. 

Synchronization generation TTL/DTL compatible composite sync output 

from 15750 pps and 30 pps pulse train. 


Time base stability 


Peak to peak jitter not to exceed 50 nanosec. 
Input .voltage 115VAC, 60Hz. 

Table-top portable. 


Mounting 

Delivery 


30 days ARO. 


